220 research outputs found

    [Multi-Scale Convergence of Cold-Land Process Representation in Land-Surface Models, Microwave Remote Sensing, and Field Observations]

    Get PDF
    The cryosphere is a major component of the hydrosphere and interacts significantly with the global climate system, the geosphere, and the biosphere. Measurement of the amount of water stored in the snow pack and forecasting the rate of melt are thus essential for managing water supply and flood control systems. Snow hydrologists are confronted with the dual problems of estimating both the quantity of water held by seasonal snow packs and time of snow melt. Monitoring these snow parameters is essential for one of the objectives of the Earth Science Enterprise-understanding of the global hydrologic cycle. Measuring spatially distributed snow properties, such as snow water equivalence (SWE) and wetness, from space is a key component for improvement of our understanding of coupled atmosphere-surface processes. Through the GWEC project, we have significantly advanced our understandings and improved modeling capabilities of the microwave signatures in response to snow and underground properties

    An improved algorithm for retrieval of snow wetness using C-band AIRSAR

    Get PDF
    This study shows recent results of our efforts to develop and verify an algorithm for snow wetness retrieval from a polarimetric SAR (Synthetic Aperture Radar). Our algorithm is based on the first-order scattering model with consideration of both surface and volume scattering. It operates at C-band and requires only rough information about the ice volume fraction in snowpack. Comparing ground measurements and inferred from JPL AIRSAR data, the results showed that the relative error inferred from SAR imagery was within 25 percent. The inferred snow wetness from different looking geometries (two flight passes) provided consistent results within 2 percent. Both regional and point measurement comparisons between the ground and SAR derived snow wetness indicates that the inversion algorithm performs well using AIRSAR (Airborne Synthetic Aperture Radar) data and should prove useful for routine and large-area snow wetness (in top layer of a snowpack) measurements

    Personalized Federated Learning with Hidden Information on Personalized Prior

    Full text link
    Federated learning (FL for simplification) is a distributed machine learning technique that utilizes global servers and collaborative clients to achieve privacy-preserving global model training without direct data sharing. However, heterogeneous data problem, as one of FL's main problems, makes it difficult for the global model to perform effectively on each client's local data. Thus, personalized federated learning (PFL for simplification) aims to improve the performance of the model on local data as much as possible. Bayesian learning, where the parameters of the model are seen as random variables with a prior assumption, is a feasible solution to the heterogeneous data problem due to the tendency that the more local data the model use, the more it focuses on the local data, otherwise focuses on the prior. When Bayesian learning is applied to PFL, the global model provides global knowledge as a prior to the local training process. In this paper, we employ Bayesian learning to model PFL by assuming a prior in the scaled exponential family, and therefore propose pFedBreD, a framework to solve the problem we model using Bregman divergence regularization. Empirically, our experiments show that, under the prior assumption of the spherical Gaussian and the first order strategy of mean selection, our proposal significantly outcompetes other PFL algorithms on multiple public benchmarks.Comment: 19 pages, 6 figures, 3 table

    DBS: Dynamic Batch Size For Distributed Deep Neural Network Training

    Full text link
    Synchronous strategies with data parallelism, such as the Synchronous StochasticGradient Descent (S-SGD) and the model averaging methods, are widely utilizedin distributed training of Deep Neural Networks (DNNs), largely owing to itseasy implementation yet promising performance. Particularly, each worker ofthe cluster hosts a copy of the DNN and an evenly divided share of the datasetwith the fixed mini-batch size, to keep the training of DNNs convergence. In thestrategies, the workers with different computational capability, need to wait foreach other because of the synchronization and delays in network transmission,which will inevitably result in the high-performance workers wasting computation.Consequently, the utilization of the cluster is relatively low. To alleviate thisissue, we propose the Dynamic Batch Size (DBS) strategy for the distributedtraining of DNNs. Specifically, the performance of each worker is evaluatedfirst based on the fact in the previous epoch, and then the batch size and datasetpartition are dynamically adjusted in consideration of the current performanceof the worker, thereby improving the utilization of the cluster. To verify theeffectiveness of the proposed strategy, extensive experiments have been conducted,and the experimental results indicate that the proposed strategy can fully utilizethe performance of the cluster, reduce the training time, and have good robustnesswith disturbance by irrelevant tasks. Furthermore, rigorous theoretical analysis hasalso been provided to prove the convergence of the proposed strategy.Comment: The latest version of this article has been accepted by IEEE TETC

    On Simulating the Impacts of Open Water Bodies on the SMAP Passive Soil Moisture Data Product

    Get PDF
    The Soil Moisture Active and Passive (SMAP) mission is a NASA earth science mission aiming at improving our understanding of the dynamics of the cycles of energy, water, and carbon at global scales. The mission features two complementary sensors on the same low-Earth orbiting platform: an L-band synthetic aperture radar (SAR) operating at 1.26 GHz and an L-band radiometer operating at 1.41 GHz. Together these instruments will provide global mapping of soil moisture and freeze/thaw states in 2-3 days, with a tentative launch date in 2014. The work reported in this study focuses primarily on the development of the SMAP radiometer-only soil moisture data product. For passive soil moisture retrieval at satellite footprint scales, one way to improve retrieval accuracy is to correct for the microwave emission from open water bodies prior to retrieval. The accuracy of this correction will depend on not only the locations of these water bodies, but also the geolocation accuracy of the instrument. As perfect knowledge is never attainable in practice, it is important to assess the impacts of these uncertainties on the SMAP radiometer observations and hence the passive soil moisture retrieval accuracy. In this presentation, we present the results of our preliminary assessment on the impacts of these uncertainties. Our study consists of two parts: (1) a sensitivity analysis on the SMAP radiometer observations due to uncertainties in water-body classification, and (2) realistic global simulations that take into account of additional uncertainties (e.g., geolocation and ancillary data) and SMAP-specific instrument characteristics (e.g., orbit sampling and antenna pattern). The results will provide valuable prelaunch guidance to the SMAP team in identifying different error sources and their relative impacts on the passive soil moisture data product

    Federated cINN Clustering for Accurate Clustered Federated Learning

    Full text link
    Federated Learning (FL) presents an innovative approach to privacy-preserving distributed machine learning and enables efficient crowd intelligence on a large scale. However, a significant challenge arises when coordinating FL with crowd intelligence which diverse client groups possess disparate objectives due to data heterogeneity or distinct tasks. To address this challenge, we propose the Federated cINN Clustering Algorithm (FCCA) to robustly cluster clients into different groups, avoiding mutual interference between clients with data heterogeneity, and thereby enhancing the performance of the global model. Specifically, FCCA utilizes a global encoder to transform each client's private data into multivariate Gaussian distributions. It then employs a generative model to learn encoded latent features through maximum likelihood estimation, which eases optimization and avoids mode collapse. Finally, the central server collects converged local models to approximate similarities between clients and thus partition them into distinct clusters. Extensive experimental results demonstrate FCCA's superiority over other state-of-the-art clustered federated learning algorithms, evaluated on various models and datasets. These results suggest that our approach has substantial potential to enhance the efficiency and accuracy of real-world federated learning tasks

    Inter-Calibration of Satellite Passive Microwave Land Observations from AMSR-E and AMSR2 Using Overlapping FY3B-MWRI Sensor Measurements

    Get PDF
    The development and continuity of consistent long-term data records from similar overlapping satellite observations is critical for global monitoring and environmental change assessments. We developed an empirical approach for inter-calibration of satellite microwave brightness temperature (Tb) records over land from the Advanced Microwave Scanning Radiometer for EOS (AMSR-E) and Microwave Scanning Radiometer 2 (AMSR2) using overlapping Tb observations from the Microwave Radiation Imager (MWRI). Double Differencing (DD) calculations revealed significant AMSR2 and MWRI biases relative to AMSR-E. Pixel-wise linear relationships were established from overlapping Tb records and used for calibrating MWRI and AMSR2 records to the AMSR-E baseline. The integrated multi-sensor Tb record was largely consistent over the major global vegetation and climate zones; sensor biases were generally well calibrated, though residual Tb differences inherent to different sensor configurations were still present. Daily surface air temperature estimates from the calibrated AMSR2 Tb inputs also showed favorable accuracy against independent measurements from 142 global weather stations (R2 ≥ 0.75, RMSE ≤ 3.64 °C), but with slightly lower accuracy than the AMSR-E baseline (R2 ≥ 0.78, RMSE ≤ 3.46 °C). The proposed method is promising for generating consistent, uninterrupted global land parameter records spanning the AMSR-E and continuing AMSR2 missions
    • …
    corecore